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Method and apparatus for predicting whether a specified event will occur after a specified 




trigger event has occurred 





(57) In many situations it is required to predict if and/ 
or when an event will occur after a trigger. For example, 
businesses such as banks would like to predict if and 
when their customers are likely to leave after a particular 
event such as closing a loan. The business is then able 
to take action to prevent loss of customers. Customer 
data including data about customer who have closed a 
loan and then left a bank for example, is used to create 
a Bayesian statistical model. A plurality of attributes are 



available for each customer and the model involves par- 
titioning these attributes into a plurality of partitions. In 
one embodiment the Bayesian statistical model is a sur- 
vival analysis type model and in another embodiment 
the model comprises fitting a Weibull distribution to the 
data in each of the partitions. The marginal likelihood of 
the data is calculated and then the method involves mix- 
ing overall possible partitions in a Bayesian framework. 
Alternatively an optimal set of partitions which best pre- 
dicts the data is chosen. 
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Description 

[0001] This invention relates to a method and apparatus for predicting whether a specified event will occur for an 
entity after a specified trigger event has occurred for that entity. The invention is particularly related to, but in no way 

5 limited to, predicting customer behaviour using a Bayesian statistical technique. 

[0002] In many situations it is required to predict if and/or when an event will occur after a trigger. For example, 
businesses would like to predict if and when their customers are likely to leave after a particular event. The business 
is then able to take action to prevent loss of customers. Another case involves predicting if and when a bank customer 
is likely to take out a mortgage after a trigger such as a salary increase or change in marital status. The bank would 

10 then be able to actively market its mortgages to specifically targeted groups of customers who are likely to be consid- 
ering many different mortgage providers. Many other examples exist outside the banking and business fields. For 
example, predicting the time to death of patients after the trigger of a particular disease, which is known as "survival 
analysis" in the field of statistics. 

[0003] Bayesian statistical techniques have been used to "learn" or make predictions on the basis of a historical data 
15 set. Bayes' theorem is a fundamental tool for a learning process that allows one to answer questions such as "How 
likely is my hypothesis in view of these data?" For example, such a question could be "How likely is a particular future 
event to occur in view of these data?" 
[0004] Bayes theorem is written as : 



[0005] Which can also be written as: 
25 P(H I data) ~ P(data /hi)* P(H) 



[0006] Because P(data) is unconditional and thus does not depend on H. 

[0007] The probability of H given the data, P(H/data) is called the posterior probability of H . The unconditional prob- 
30 ability of H, P(H) is called the prior probability of H and the probability of the data given H, P(data/H) is called the 
likelihood of H. By using knowledge and experience about past data an assessment of the prior probability can be 
made. New data is then collected and used to update the prior probability following Bayes theorem to produce a pos- 
terior probability. This posterior probability is then a prediction in the sense that it is a statement about the likelihood 
of a particular event occurring in the future. However, it is not simple to design and implement such Bayesian statistical 
35 methods in ways that are suited to particular practical applications. 

[0008] It is accordingly an object of the present invention to provide a method and apparatus for predicting whether 
a specified event will occur for an entity after a specified trigger event has occurred for that entity, which overcomes 
or at least mitigates one or more of the problems noted above. 

[0009] According to an aspect of the present invention there is provided a method of predicting whether a specified 
40 event will occur for an entity after a specified trigger event has occurred for that entity, comprising the steps of:- 

• accessing data about other entities for which the specified event has occurred in the past after the specified trigger 
event; 

• accessing data about the entity for which the prediction is required; 

45 • creating a Bayesian statistical model on the basis of at least the accessed data; and 

• using the model to generate the prediction; wherein the data comprises a plurality of attributes associated with 
each entity and wherein creating the model comprises partitioning the attributes into a plurality of partitions. 

[0010] A corresponding computer system is also provided for predicting whether a specified event will occur for an 
50 entity after a specified trigger event has occurred for that entity, comprising:- 

• an input arranged to access data about other entities for which the specified event has occurred in the past after 
the specified trigger event; and wherein said input is further arranged to access data about the entity for which the 
prediction is required; wherein the data comprises a plurality of attributes associated with each entity; 

55 • a processor arranged to create a Bayesian statistical model on the basis of at least the accessed data by partitioning 
the attributes into a plurality of partitions; and wherein the processor is further arranged to use the model to generate 
the prediction. 
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[0011] A corresponding computer program is provided, arranged to control a computer system in order to predict 
whether a specified event will occur for an entity after a specified trigger event has occurred for that entity, said computer 
program being arranged to control said computer system such that:- 

5 © data is accessed about other entities for which the specified event has occurred in the past after the specified 
trigger event; 

• data is accessed about the entity for which the prediction is required, wherein the data comprises a plurality of 
attributes associated with each entity; 

• a Bayesian statistical model is created on the basis of at least the accessed data by partitioning the attributes into 
10 a plurality of partitions; and 

• the model is used to generate the prediction. 

[0012] This provides the advantage that it is possible to predict whether an event will occur after a trigger event. For 
example, the entities may be bank customers and using the method it is possible to predict whether a customer will 

15 leave a bank after having closed a loan with that bank. Data comprising customer attributes, such as the age, sex, 
salary, number of credit cards, number of loans, or current bank balance of the customers is used. A Bayesian statistical 
model is created and in doing this the attributes (which can be considered as existing in a space of attributes) are 
divided into a plurality of partitions. That is the space of attributes is divided into partitions. By partitioning the attributes 
in this way the method is found to be particularly effective. Predictions are found to correspond well to empirical data 

20 in tests of the method as described further below and to give improved results as compared with prior art models which 
use global modelling techniques. By partitioning the attributes, the failings of global modelling techniques such as the 
method of Chen, Ibrahim and Sinha (see the section headed "references" below for bibliographic details of this publi- 
cation) are avoided. 

[0013] Preferably the Bayesian statistical model comprises a survival analysis type model which is arranged to take 
25 into account the assumption that the specified event will not occur for some of the entities. For example, in the case 
that the time to death of patients with a particular disease is being investigated, it is assumed that a proportion of these 
patients will not die and will be cured. Survival analysis models have previously used generalised linear models to 
accountforcustomer/patient attributes. These global models typically lack sufficient flexibility to account forthe variation 
across customers attributes in survival times. The present invention provides the advantage that a survival analysis 
30 model is adapted to fit a local model for customer attributes. An embodiment of the present invention maintains the 
proportional hazards property which although restrictive can be advantageous. The proportional hazards property im- 
plies that the ratio of the hazards for two customers is constant over time provided that their attributes do not change. 
[0014] In another preferred embodiment the step of creating the model comprises fitting a Weibull distribution to the 
data within each partition. This provides the advantage that by fitting the Weibull distribution locally (i.e. within each 
35 partition) considerable modelling flexibility is gained. At the same time, the drawbacks of previous global survival models 
are overcome by using local modelling. This embodiment moves away from the restriction of proportional hazards. 
[0015] Further benefits and advantages of the invention will become apparent from a consideration of the following 
detailed description given with reference to the accompanying drawings, which specify and show preferred embodi- 
ments of the invention. 

40 [0016] Figure 1 is a flow diagram of a method for predicting whether a specified event will occur for an entity after a 
specified trigger event has occurred for that entity. 

[0017] Figure 2 is a schematic diagram of a computer system for predicting whether a specified event will occur for 
an entity after a specified trigger event has occurred for that entity. 

[0018] Figure 3 is a flow diagram of a method for predicting whether a specified event will occur for an entity after a 
45 specified trigger event has occurred for that entity. 

[0019] Figure 4 is a flow diagram of another embodiment of a method for predicting whether a specified event will 

occur for an entity after a specified trigger event has occurred for that entity. 

[0020] Figure 5 is a flow diagram of a method of sampling for a tessellation structure. 

[0021] Figure 6 is a table containing example input data for the computer system of Figure 2 and example output 
50 data obtained from that computer system as well as corresponding empirical data. 
[0022] Figure 7 is graph of the output data of Figure 6. 

[0023] Embodiments of the present invention are described below by way of example only. These examples represent 
the best ways of putting the invention into practice that are currently known to the Applicant although they are not the 
only ways in which this could be achieved. 
55 [0024] Consider a business such as a bank. This bank may have beliefs, experience and past data about customer 
transactions. Using this information the bank can form an assessment of the prior probability that a particular customer 
will exhibit a certain behaviour, such as leave the bank. The bank may then collect new data about that customer's 
behaviour and using Bayes' theorem can update the prior probability using the new observed data to give a posterior 
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probability that the customer will exhibit the particular behaviour such as leaving the bank. This posterior probability is 
a prediction in the sense that it is a statement of the likelihood of an event occurring. In this way the present invention 
uses Bayesian statistical techniques to make predictions about customer behaviour. However, as mentioned above, 
it is not simple to design and implement such methods in ways that are suited to particular applications. The present 

5 invention involves such a method and is described in more detail below. 

[0025] Figure 1 is a flow diagram of a method for predicting whether a specified event will occur for an entity after a 
specified trigger event has occurred for that entity. Data is accessed about entities for which a specified event has 
occurred in the past after a specified trigger event (see box 1 0 of Figure 1 ) . The entities may be customers, individuals, 
or any other suitable item such as a computer system. For example, the data comprises customer attributes such as 

10 age, sex and salary for customers who have closed a loan and then left the bank. More data is then accessed (see 
box 11 of Figure 1) about an entity for which it is required to make a prediction. For example, this data may comprise 
customer attributes associated with customers for whom it is required to predict whether they will leave a bank after 
closing a loan. 

[0026] A Bayesian statistical model is then created (see box 12 of Figure 1) on the basis of at least the accessed 
15 data and this model is used to generate the predictions. The process of generating the model comprises partitioning 
the attributes in to a plurality of partitions, 

[0027] Two embodiments of the method of Figure 1 are now described. The first embodiment takes a Bayesian 
survival model and adapts it such that attribute data are partitioned. The second embodiment involves fitting a Weibull 
distribution to the customer attribute data within each partition. Both embodiments are described below with respect 
20 to a particular application, that of predicting if and/or when a customer will leave a bank after having paid off a loan. 
However, this embodiment is also suitable for other applications in which it is required to predict whether a specified 
event will occur for an entity after a specified trigger event has occurred for that entity. 

[0028] The methods of both these embodiments may be implemented using any suitable programming language 
executed on any suitable computing platform. For example, Matlab (trade mark) may be used together with a personal 
25 computer. A user interface is provided such as a graphical user interface to allow an operator to control the computer 
program, for example, to adjust the model, to display the results and to manage input of customer data. Any suitable 
form of user interface may be used as is known in the art. 

[0029] Figure 2 is a schematic diagram of a computer system for predicting whether a specified event will occur for 
an entity after a specified trigger event has occurred for that entity. The computer system comprises a processor 23 

30 which may be any suitable type of computing platform such as a personal computer or a workstation. The computer 
system has an input 25 which is arranged to receive data 21 about entities for which a specified event has occurred 
in the past after a specified trigger event. This input 25 is also arranged to receive data about an entity (or entities) for 
which it is required to predict if a specified event will occur after a specified trigger event has occurred. Using this data, 
which comprises a plurality of attributes associated with each entity, the processor generates a Bayesian statistical 

35 model and partitions the attributes into a plurality of partitions. Once the model is formed it is used by the processor 
23 to generate predictions 24 about if and/or when the specified event will occur after the specified trigger event for 
one or more entities. 

[0030] The first embodiment is now described: 

[0031] A common problem faced by banks is customer attrition. In order to deal with this problem banks required 
40 the answer to the question "will customer A leave the bank?" We are interested in the case where customer attrition 
occurs after a particular event. For example, customers may leave a bank after having paid off a loan. If we can predict 
who will leave and the time between closing the account and leaving the bank, then action can be taken to prevent the 
customer leaving. 

[0032] This problem is similar to the statistical subject of survival analysis. In a typical medical survival analysis 
45 problem the time to death of a patient with a particular disease is investigated. Typical models assume that all patients 
will eventually die from the disease. However, in the present invention it is assumed that a proportion of the customers 
will not leave the bank due to the particular event. In medicine this is equivalent to a proportion of the patients being 
cured and models which have accounted for this allow for a so called "cure rate". 

[0033] A Bayesian survival model has been developed (Chen, Ibrahim and Sinha, Journal of the American Statistical 
so Association, 1999) which allows for a cure rate. The model described in the paper allows the cure rate to vary for 
individuals with different attributes by using a generalised linear model. A generalised linear model is a global model. 
In a global model an assumption is made about how the data is distributed as a whole and so global modelling is a 
search for global trends. However, all customers may not follow a global trend; some subpopulations of customers 
may differ radically from others. The present invention extends the work of Chen, Ibrahim and Sinha (1999) to model 
55 the customer attributes locally avoiding the failings of the global generalised linear model. 
[0034] The first embodiment is now described with reference to Figure 3. 

[0035] In order to create the Bayesian statistical model, first prior distributions are chosen on the basis of beliefs, 
experience and past data about customer attributes and behaviour (see box 31 of Figure 3). For example, the prior 
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distributions may be specified as gamma distributions. A tessellation structure and parameters for the model are than 
initialised (see box 32 of Figure 3) for example, by assigning random values. The customer attributes are considered 
as being represented in a customer attribute space and the tessellation structure represents division of this space into 
partitions. 

5 [0036] Any suitable sampling method such as a Gibbs sampling method is then used to form a posterior probability 
distribution from the prior distributions and customer data. This is represented by box 40 of Figure 3. This process 
comprises sampling for the tessellation structure (box 33 of Figure 3) and sampling for a cure rate within each partition 
(box 34) by making a standard draw from a gamma distribution (in the case that the prior distributions are modelled 
as gamma distributions). As well as this, the method comprises, for each customer, sampling for N, which is the number 

10 of latent risks (box 35). The number of latent risks is an indication of how likely a customer is to leave the bank. The 
greater the number of latent risks the more likely the customer is to leave, in one example, sampling for N is achieved 
by making a standard draw from a Poisson distribution. The next stage involves sampling for parameters of the distri- 
bution of the latent risks. In one example, this is achieved by making standard draws for the parameters of a Weibull 
distribution. 

15 [0037] The sampling steps of box 40 of Figure 3 are repeated until sufficient samples are obtained to enable the 
posterior probability distribution to be described and "reconstructed". For example, this is done by repeating the sam- 
pling steps for a prespecified large number of iterations and assuming that sufficient samples will have been drawn 
(for example several thousand iterations). The results may then be compared with empirical data and the effect of 
further iterations assessed. Once sufficient samples have been obtained the model is said to have converged. Thus 

20 in Figure 3 a decision point 37 is shown with the test "Has Markov chain converged?". If the answer to this question 
is "no" and insufficient samples have been drawn the sampling method is repeated starting from box 33. If the answer 
to this question is "yes" then the posterior probability distribution is assumed to have been adequately described. In 
that case, the sampling method is repeated in order to draw samples from the reconstructed probability distribution 
(box 38) and these samples are used to generate probabilities as to if and when each customer will leave the bank 

25 (box 39). 

[0038] The step of sampling for the tessellation structure (box 33 of Figure 3) is shown in more detail in Figure 5. 
This is an iterative process which involves adjusting the tessellation structure if a parameter u is greater than a calcu- 
lated acceptance ratio where u is a uniform random variable between 0 and 1 . The first step involves either adding a 
new hyperplane, removing an existing hyperplane or moving an existing hyperplane. Once this has been done a rep- 

30 resentation of the tessellation structure is revised in order to take into account the change. For example, the tessellation 
structure may be represented using a temporary hash table which is recalculated to take into account the change (box 
52). A marginal likelihood is then calculated (this is described in more detail below) (box 53) and an acceptance ratio 
also calculated (box 54). The parameter u is then uniformly drawn (box 55) using a sampling method. If u is greater 
than the acceptance ratio then no changes are made to the tessellation structure (box 58). However, if u is less than 

35 the acceptance ratio then the process is repeated (box 57). 

[0039] The first embodiment and the way in which this extends the work of Chen, Ibrahim and Sinha is now described 
in more detail: 

[0040] The approach described by Chen, Ibrahim and Sinha models the unknown number of cancerous cells, or 
more generally "risks", in a patient. If a patient has no cancerous cells the patient is said to be cured, otherwise the 
40 risk is assumed to increase with the number of cancerous cells. The number of risks, denoted by N, is modelled as a 
Poisson distribution. The time to death due to risk /is denoted by Z v The model assumes that the random variables 
Z 1( ...,Z n are independent and identically distributed (i.i.d.) with a common distribution function F(f) = 1 - S(Q, where S 
(f) is known as the survival function and represents the probability of surviving to time t. The overall survival function 
is given by the probability of surviving N risks until time f. This is written as 

45 

S p (t) = P(alive at time /) 

= P(N = Q) + P(Z l >*,... ,Z„ > t,N >1) 

50 co g 

= exp(- 4 + ]►>(/)* TTexp(- 4 
= exp(- #(/)) = exp(- &(t)) 

55 

t is the response of interest, for example the time between a customer closing a loan and leaving the bank. The dis- 
tribution function F(r) of the risks Zcan take any form, for example the Weibull distribution is used. However, it is not 
essential to use the Weibull distribution; any other suitable distribution can be used. The Weibull distribution has the 
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following density function 



10 



35 



40 



45 



50 



p(f/a, X) = Xaf-'^exp(-Xf 1 ) 

Chen, Ibrahim and Sinha model the parameter of the Poisson distribution with a generalised linear model, thus 

6=exp(X , p), 



a generalised linear model. A customer's attributes are denoted by X and p denotes the parameters. Thus if we have 
p customer attributes X At ...,X p we will have parameters p^.^Pp- This is a global model because the parameters, p, 
take the same value for each customer. The unknown parameters of the model are A/ 1f ...,A/ n , X t y and p where X and y 
are the parameters of the Weibull distribution. As with most Bayesian models, the posterior distribution of the unknown 

15 parameters cannot be expressed analytically. The Gibbs sampler is a widely used method for drawing random values 
from posterior distributions. The posterior distribution is reconstructed from the samples generated by the Gibbs sam- 
pler. To implement a Gibbs sampler the full conditional distributions of the parameters are required. Sampling for p is 
not standard. An algorithm exists to draw from the full conditional distribution of each component of p. However the 
algorithm is relatively computationally expensive and p draws will be required from it for each sweep of the Gibbs 

20 sampler. 

[0041] Global models, such as that described by Chen, Ibrahim and Sinha are not always appropriate, particularly 
for a large set of customers. In that case a local model as described in the present invention has been found to be 
more effective. The local model of the present invention is simple and more flexible than the generalised linear model 
used previously. The space of customer attributes is split into disjoint sub-populations or partitions. The partitions are 
25 defined geometrically. For example, hyperplanes are used to divide the space of customer attributes. Within each 
subpopulation a constant response 6 is fit, the most simple of local models. 

[0042] The unknown parameters of the model are A/j ,...,/¥„, a, X„ T and 6-,,..., 0 m where T denotes the tessellation 
structure with m sub-populations or partitions. We denote the response in the partition j by 6y, the number of observations 

in partition /by nj, the latent variables in partition /by Ny t ...,N n j and the observations in partition / by ty t n j. A Gibbs 

30 sampler (or any other suitable type of sampling method) is used to draw from the posterior distribution of the unknown 
parameters which is given by 



m [ «/ *) $1 exp(— ff) 



The following prior distributions are assigned 



p(6 y ) = Ga(<p 0) q^) 
p(X)= Ga(X 0 ,X A ) 
p(a)= Ga(a 0 , a,) 



which are all gamma distributions. However, it is not essential to use Gamma distributions to model the prior distribu- 
tions. Any other suitable type of distribution can be used. 
55 The Gibbs sampler (or other sampling method) draws from the following full conditional distributions 
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p(N a \-) = ^expM,*)), i = 1 «,,; = l,...m 

/j(^,71-)= J p(21-)^(^,-X j = l,..m 



where 

/>( q\ TV - ) = Ga( A + rtfl + X AT..) 
piTl-^ccpiN^.^NJTMT) 

Ga denotes the gamma distribution and Pn denotes the Poisson distribution. The example discussed here uses Poisson 
distributions to model the full conditional distributions, however, any other suitable type of distribution can be used. An 
30 advantage of choosing the Poisson distribution is that marginal likelihoods are straightforward to calculate as described 
below. 

[0043] To fit a local model the marginal likelihood p(A/ 1 ,...,W n ) is required. The marginal likelihood is the likelihood of 
the data with the parameters 0 integrated out. 

[0044] The marginal likelihood is straightforward to evaluate in this model dueto the nature of the Poisson distribution. 
35 if we assign 6 a Gamma (6 0) e.,) priorthe marginal likelihood of the number of risks of each customer W 1 N n is given by 



40 



45 



50 



p{N lt ...,N m \%, n) = \t\p{N i \0 >P (6(^ n )d6 

1=1 iV i 1 ft 

r(fl + av,) a* 
(fl+«)* +Sv 'n(tf,!) r (^) 



Given the marginal distribution, the tessellation structure is sampled for using a Metropolis random walk, within the 
Gibbs sampler (or other sampling method). 

[0045] The resulting sampler is computationally more efficient than the equivalent sampler for the generalised linear 
model described above. Sampling for p has been replaced by sampling for the tessellation structure and the responses 
ss within each partition, both of which are straightforward. 

[0046] The method described above has been implemented using a computer system such as that illustrated in 
Figure 2. Figure 6 is a table containing example input data for the computer system of Figure 2 and example output 
data obtained from that computer system (using the method described immediately above) as well as corresponding 
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empirical data. The first four columns 60 of the table in Figure 6 are headed "co-variates" and contain attribute values. 
Each row of the table represents data for an individual bank customer. Columns 61 to 63 contain probability values 
which have either been obtained from empirical data (column 63), or which have been obtained from the method of 
the present invention (column 62), or from the prior art method of Chen, Ibrahim and Sinha (column 61). The final 

5 column 64 of table 6 shows the number of observations that were available for each customer. 

[0047] The probability values produced by the method of the present invention are closer to the empirical values 
than those produced by the prior art method of Chen, Ibrahim and Sinha. For example, for the first customer whose 
data is contained in the first row of the table, the empirical probability value is 0.2795 and the probability value predicted 
using the method of the present invention is 0.2047 whereas the prior art method gave 0.4213. 

10 [0048] Figure 7 shows a graph formed using the data of Figure 6 together with further data for other customers. The 
graph is a plot of the proportion of customers who are still with the bank (or predicted to be still with the bank) against 
time in days. The results of the prior art Chen, Ibrahim and Sinha model are represented by the upper curve 71 and 
the results of the method of the present invention by the lower curve 72. A single point 73 is shown which indicates 
the proportion of customers still with the bank after 1 year. This data point is obtained from empirical data. 

15 [0049] The data shown in Figures 6 and 7 which are produced from the method of the present invention are slight 
underestimates of the empirical data. This is because not all people who will leave the bank have actually left by the 
end of the experiment. This means that the actual proportion (from empirical data) of people who are still with the bank 
will be lower than predicted using the method of the present invention. Taking this into account, the predictions of the 
present invention are actually even closer to the empirical data in Figure 7. 

20 [0050] The second embodiment is now described with reference to Figure 4. As for the first embodiment, prior dis- 
tributions are chosen (box 41) and the tessellation structure and parameters are initialised (box 42). Using the prior 
distributions and input customer data a Gibbs sampling method (or any other suitable sampling method) is then used 
to draw samples in order to "reconstruct" the posterior probability distribution . This involves sampling for the tessellation 
structure (box 43) and then sampling for the parameters of the distribution of latent risks (box 44). This comprises 

25 taking standard draws for the parameters of the Weibull distribution (box 44). The next stage (box 45) comprises for 
each customer, sampling for N, the number of latent risks. This is achieved by taking a standard draw from a Poisson 
distribution (or any other suitable distribution). 

[0051] As in the first embodiment the sampling process is iterated until the posterior probability distribution has been 
adequately "reconstructed" (see box 46). This is achieved in any of the ways described above for the first embodiment. 
30 [0052] Once convergence has been achieved, the posterior probability distribution is assumed to be adequately 
"reconstructed" and samples are then drawn from it (box 47) using the sampling method of box 49. The samples drawn 
from the posterior probability distribution are then used to generate probabilities as to if and when each customer will 
leave the bank (box 48). 

[0053] The second embodiment is now described in more detail: 
35 The second embodiment uses a local model and splits the space of customer attributes into disjoint sub-populations 
or partitions. The partitions are defined geometrically. For example, hyperplanes can be used to divide the space of 
customer attributes. Within each partition a Weibull distribution is fitted which has the following density function: 

40 p(t\a , X) = Xaf 1 ^ exp{-Xf) 

In survival analysis t refers to the time of death of a patient. In a banking context t represents for example, the time 
between a customer closing a loan and leaving the bank. 

[0054] The local Weibull distribution makes use of the following mixture representation of the Weibull distribution: 

45 

p(t\u, a) = at/" 1 f a " 1 /(r a < u) 

2 

50 p(u\ X) = X i/exp(-u X) 

as described by Walker and Gutierrez-Pera (see the section headed "references" below for bibliographic details). It is 
straightforward to show that this mixture yields the marginal distribution 

55 

p(tla, X) = ^af ot ' 1 exp(-Xf a ) 

which is Weibull (a, X). 
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[0055] The unknown parameters of the model are u 1 u n , a 1t ..., oc m , X^..., X m and the tessellation structure Twith 

m sub-populations or partitions. The parameters of the Weibull distribution in partition /are denoted by ay, Xj, the number 
of observations in partition j is denoted by n y - and the latent variables in partition j are denoted by u : j,... ) u n j, similarly 
we denote the observations in partition j by ..,?„/ The posterior distribution of the unknown parameters is 



5 



10 



p( q,..., c^, 4 ^,u„...,u n ,T\t x ,...,t n ) = Ylpi^Pi^YlP^v °$)P( u u\ V 

y=i i=i 
15 We take the following prior distributions for a and X 

p(X y )= Ga(X 0i X,) 

20 

p(a y )= Ga(a 0 , a t ) 

However, it is not essential to represent the prior distributions using Gamma distributions. Any other suitable distribu- 
tions can be used. 

25 As with most Bayesian models, the posterior distribution of the unknown parameters cannot be expressed analytically. 
The Gibbs sampler (or any other suitable sampling method) is therefore used to draw random values from the posterior 
distribution. The posterior distribution is then reconstructed from the samples generated by the Gibbs (or other) sampler. 
To implement the Gibbs (or other) sampler the full conditional distributions of the parameters are required. In the present 
embodiment we draw from the following full conditional distribution 
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= P(«1 « m . V- ^ T >U *n> "1 w n )p(7lf 1 ,... l f nl u 1 u n ) 

p(u v ...,u n \ai a m ,Xi X m ,Tj v ... t t n ) 

Given a tessellation structure o^,..., a m , X^..., X m and u 1t ...,u n are independent and their full conditional distributions 
are as follows; 
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p(^|-0 = Ga^|2/i f + 4, % + |>,) j = 1,..., 
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The distribution of a tessellation structure is given by 
[0056] Thus we require the marginal distribution 
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p(f 1 .....f„.Ui u n ) = p(t v ...,t n \u^...,u n )p(u^ u„) 



The first term on the right hand side is given by 
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pU x ,...,t n \u x ,...,u K ) = \Y[p{t t \u n dip{ciida 



15 |f m = n + <Xq - 1 is an integer this integral can be evaluated by parts as follows 
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I m =jx m cxp(xs)dx 

a 

H exp(xs)? m 



"1 
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1 m 



"(-§)' 



"1* 



exp(xs) 



30 The marginal distribution of the latent variables is given by 
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r(4) 



-J i n+vl 



exp< - a 
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Given the marginal distribution p(t^ i ...,t m u v ... f u n ) = p(f 1> ... J f n lu 1 ,...,tv n )p(u 1) ... I u, I ) the tessellation structure is sampled 
for using a Metropolis random walk within the Gibbs (or other) sampler. 

[0057] A range of applications are within the scope of the invention. These include situations in which it is required 
to predict whether a specified event will occur for an entity after a specified trigger event has occurred for that entity. 
50 For example, to if and when a customer will leave a bank after that customer has closed a loan with the bank. Other 
examples include predicting the lifetime of a patient after that patient has contracted a particular disease. 
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Claims 

1 . A method of predicting whether a specified event will occur for an entity after a specified trigger event has occurred 
for that entity, comprising the steps of> 

5 

(i) accessing data about other entities for which the specified event has occurred in the past after the specified 
trigger event; 

(ii) accessing data about the entity for which the prediction is required; 

(iii) creating a Bayesian statistical model on the basis of at least the accessed data; and 

10 (iv) using the model to generate the prediction; wherein the data comprises a plurality of attributes associated 

with each entity and wherein creating the model comprises partitioning the attributes into a plurality of partitions. 

2. A method as claimed in claim 1 which further comprises predicting when the specified event will occur. 
15 3. a method as claimed in claim 1 or claim 2 wherein the entities are customers. 

4. A method as claimed in any preceding claim wherein the specified event is leaving a bank. 

5. A method as claimed in any preceding claim wherein the specified trigger event is closing a loan. 

6. A method as claimed in any preceding claim wherein said model comprises a survival analysis type model. 
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7. A method as claimed in claim 6 wherein said survival analysis type model is arranged to take into account the 
assumption that the specified event will not occur for some of the entities. 

8. A method as claimed in any preceding claim wherein the step of creating the model further comprises calculating 
the marginal likelihood of latent risks within each partition. 

9. A method as claimed in any preceding claim wherein the step of creating the model further comprises mixing over 
30 all possible partitions in a Bayesian framework. 

10. A method as claimed in any of claims 1 to 8 wherein the step of creating the model further comprises choosing an 
optimal set of partitions which best predicts latent risks within each partition. 

35 1 1 . A method as claimed in claim 9 wherein the step of mixing over all possible partitions comprises using a sampling 
method. 

12. A method as claimed in any of claims 1 to 5 wherein said step of creating the model comprises fitting a Weibull 
distribution to the data within each partition. 

40 

13. A method as claimed in claim 12 wherein said step of creating the model comprises calculating the marginal 
likelihood of the data. 

14. A method as claimed in claim 13 wherein said step of creating the model further comprises mixing over all possible 
45 partitions in a Bayesian framework. 

15. A method as claimed in claim 13 wherein said step of creating the model further comprises choosing an optimal 
set of partitions which best predicts the data. 

so 1 6. A method as claimed in claim 1 4 wherein said step of mixing over all possible partitions comprises using a sampling 
method. 

17. A computer system for predicting whether a specified event will occur for an entity after a specified trigger event 
has occurred for that entity, comprising:- 
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(i) an input arranged to access data about other entities for which the specified event has occurred in the past 
after the specified trigger event; and wherein said input is further arranged to access data about the entity for 
which the prediction is required; wherein the data comprises a plurality of attributes associated with each entity; 
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(ii) a processor arranged to create a Bayesian statistical model on the basis of at least the accessed data by 
partitioning the attributes into a plurality of partitions; and wherein the processor is further arranged to use the 
model to generate the prediction. 

5 18. A computer program arranged to control a computer system in order to predict whether a specified event will occur 
for an entity after a specified trigger event has occurred for that entity, said computer program being arranged to 
control said computer system such that:- 

(i) data is accessed about other entities for which the specified event has occurred in the past after the specified 
10 trigger event; 

(ii) data is accessed about the entity for which the prediction is required, wherein the data comprises a plurality 
of attributes associated with each entity; 

(iii) a Bayesian statistical model is created on the basis of at least the accessed data by partitioning the at- 
tributes into a plurality of partitions; and 

15 (iv) the model is used to generate the prediction. 

19. A computer program as claimed in claim 18 which is stored on a computer readable medium. 
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Sample for N, the number of latent risks 
for each customer. Standard draw from 
the Poisson distribution. 
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Sample for the parameters of the distribution 
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parameters of Weibull distribution. 
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